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ABSTRACT 

Multi-frame  blind  deconvolution  (MFBD)  algorithms  can  be  used  to  leconstruct  a  single  high-i  esolution  image  of  an 
object  from  one  or  more  measurement  frames  of  that  are  blurred  and  noisy  realizations  of  that  object.  The  blind  natuie 
of  MFBD  algorithms  permits  the  reconstruction  process  to  proceed  without  having  separate  measurements  or 
knowledge  of  die  blurring  functions  in  each  of  the  measurement  frames.  This  is  accomplished  by  estimating  the  object 
common  to  all  the  measurement  frames  jointly  with  the  blurring  functions  that  are  different  from  frame  to  flame.  An 
issue  of  key  importance  is  understanding  how  accurately  the  object  pixel  intensities  can  be  estimated  with  the  use  of 
MFBD  algorithms.  Here  we  present  algorithm-independent  lower  bounds  to  the  variances  of  estimates  of  the  object 
pixel  intensities  to  quantify  the  accuracy  of  these  estimates  when  the  blurring  functions  are  estimated  pixel  by  pixel. 
We  employ  support  constraints  on  botii  the  object  and  the  blurring  functions  to  aid  in  making  the  inverse  problem 
unique.  The  lower  bounds  are  presented  as  a  function  of  the  sizes  and  shapes  of  these  support  regions  and  the  number 
of  measurement  frames. 

Keywords:  support,  blind  deconvolution,  multi-frame  blind  deconvolution,  Cramer-Rao  lower  bounds,  image 
reconstruction,  noise  reduction 


1.  INTRODUCTION 

A  common  estimation  problem  is  that  of  reconstructing  a  high-resolution  image  of  an  object  from  one  or  more 
measurement  frames  that  are  blurred  and  noisy  realizations  of  that  object.  When  the  blurring  functions  for  all  of  the 
measurement  frames  are  known,  it  is  straightforward  to  reconstruct  a  high-resolution  image  of  the  object  whose 
resolution  is  limited  only  by  the  noise  levels  in  the  image  and  the  bandpass  of  the  imaging  system.  However,  in  many 
cases,  the  blurring  functions  are  not  known  a  priori,  nor  are  separate  measurements  of  them  available.  A  good  example 
of  this  situation  is  astronomical  imaging  from  ground-based  sites  in  tbe  presence  of  atmospheric  tuibulence  when  a 
wavefront  sensor  is  not  present.  In  such  situations,  multi-frame  blind  deconvolution  (MFBD)  algorithms1  can  be  used 
to  jointly  estimate  both  the  object  common  to  all  the  measurement  frames  and  each  measurement  frame’s  blurring 
function.  In  the  course  of  our  previous  research  efforts,  we  have  discovered  that  our  MFBD  algorithm  can  reconstruct 
unique  estimates  of  the  object  and  die  blurring  functions  as  long  as  die  algorithm  is  regularized  properly,  the  integrated 
values  of  die  object  and  each  blurring  function  are  constrained  to  be  constant,  and  appropriate  prior  knowledge 
constraints  are  placed  on  the  object  and  blurring  function  reconstructions.  In  addition,  we  have  discovered  that 
reconstructions  of  object  intensity  values  produced  by  our  MFBD  algorithm  have  lower  variances  than  produced  by 
competing  methods  (such  as  speckle  imaging  techniques2).  We  have  also  discovered  that,  when  comparing  results  from 
our  MFBD  algorithm  to  die  results  from  another  MFBD  algorithm,  our  results  have  lower  variances. 

Motivated  by  these  last  two  discoveries,  we  have  undertaken  an  analysis  of  the  performance  of  MFBD  algorithms  to 
detennine  fundamental  limits  to  die  accuracy  of  estimates  of  object  intensity  values  generated  by  MFBD  algorithms  in 
terms  of  the  variances  of  these  estimates.  By  fundamental  limits,  we  mean  limits  that  are  independent  of  any  particular 
MFBD  algorithm.  To  this  end,  we  are  using  Cramdr-Rao  lower  bound  (CRB)  theory3  to  carry  out  the  analysis.  This 
theory  can  be  used  to  generate  algoridun-independent  lower  bounds  (called  CRBs)  to  the  variances  of  any  unbiased 
estimates  of  a  set  of  parameters.  Often  unbiased  estimates  cannot  be  obtained  and  thus  only  biased  estimates  can  be 
produced.  For  example,  imaging  systems  produce  low-pass-filtered  versions  of  die  scenes  they  image.  Without  the 
higher  spatial  frequencies,  only  a  low-pass-filtered  (thus  biased)  version  of  die  original  scene  can  be  reconstructed.  The 


particular  low-pass  (that  is,  regularization)  filter  used  in  the  reconstruction  algorithm  determines  the  bias  in  the 
reconstruction.  When  this  is  the  case,  CRB  theory  can  be  used  to  generate  algorithm-independent  but  bias 
(regularization)-dependent  lower  bounds  to  the  variances  of  any  biased  estimates  of  a  set  of  parameters. 

We  began  this  analysis  project  by  assuming  that  the  blurring  functions  are  known  (thus  the  estimation  process  is  non- 
blind)  and  explored  how  the  accuracy  of  estimates  of  the  object  intensity  values  are  affected  by  the  inclusion  of  a 
support  constraint  on  the  object.4  We  generated  CRBs  for  the  non-blind  case  as  a  function  of  the  size  and  shape  of  the 
support  constraint,  die  type  and  amount  of  noise  in  the  measurements,  and  the  type  and  amount  of  regularization.  To 
see  how  well  the  non-blind  version  of  our  MFBD  algorithm  performs,  we  then  compared  sample  variances  produced 
using  this  version  of  our  MFBD  algoridnn  to  the  CRBs  and  discovered  that  the  sample  variances  were  either  the  same 
or  close  to  the  CRBs. 

In  this  paper,  we  present  our  initial  results  describing  the  application  of  CRB  theory  to  blind  deconvolution  when  bodi 
the  object  and  the  blurring  functions  are  estimated  pixel  by  pixel  in  the  image  domain.  We  employed  support 
constraints  to  make  the  inverse  problem  (for  a  given  regularization  filter)  unique.  We  generated  object  CRBs  (hereafter 
referred  to  just  as  CRBs)  as  a  function  of  the  size  and  shape  of  both  the  object  and  bluning  function  support  constraints 
and  the  number  of  measurement  frames.  Herein  we  present  some  of  these  CRBs  and  compare  them  to  the  non-blind 
case.  In  general,  the  pixel-based  blind  deconvolution  CRBs  are  greater  (often  by  more  than  an  order  of  magnitude)  than 
the  associated  non-blind  CRBs.  The  paper  is  organized  as  follows:  Section  2  contains  the  imaging  model  used  for  the 
results  in  this  paper,  CRB  theory  is  described  briefly  in  Section  3,  results  are  given  in  Section  4,  and  conclusions  and 
future  work  are  presented  in  Section  5. 


2.  PROBLEM  FORMULATION 

The  equation  describing  image  fonnation  is 

i(x)  =  h(x)  *  o(x) + n(x)  (1) 

where  bold-face  type  indicates  vector  or  matrix  quantities,  *  denotes  convolution,  x  is  a  two-dimensional  spatial 
variable,  i(x)  is  the  measured  image,  h(x)  is  the  system  point  spread  function  (PSF),  o(x)  is  the  object  being  imaged,  and 
n(x)  is  the  zero-mean  noise  corrupting  the  measured  image.  Although  n(x)  is  shown  as  additive,  it  models  both  Poisson 
and  CCD  read  noise.  For  the  results  presented  in  Section  4,  we  model  h(x)  as  being  the  PSF  associated  with  imaging 
through  the  atmosphere  using  an  ideal  imaging  system  with  an  unobscured  aperture.  We  characterize  the  imaging 
system  by  the  diameter  D  of  its  exit  pupil  and  the  atmosphere  by  the  Fried  parameter  r0.  All  the  results  in  Section  4 
assume  that  the  ratio  D/r0  is  equal  to  four.  The  true  object  used  for  o(x)  in  Section  4  is  the  satellite  model  shown  in  Fig. 

1. 


3.  CRAMER-RAO  LOWER  BOUOT  THEORY 

We  first  present  a  brief  overview  of  both  unbiased  and  biased  CRB  theory  in  this  section.  Although  only  biased  CRB 
theoiy  is  used  for  the  results  in  Section  4  since  h(x)  is  a  low-pass  filter,  the  unbiased  CRB  theory  provides  important 
insight  into  how  the  biased  CRBs  are  generated,  both  theoretically  and  numerically.  We  then  discuss  numerical 
implementation  issues  that  undergird  the  results  in  Section  4. 


If 


Fig.  1.  Computer-simulated  satellite  model  used  for  CRB  results. 


3.1  Unbiased  CRB  theory 

Standard  CRB  theory,  both  unbiased  and  biased,  assumes  that  the  number  of  parameters  to  be  estimated  are  finite.  For 
this  reason,  the  imaging  model  of  Eq.(l)  must  be  rewritten  in  a  vector  form  rather  than  as  a  function  of  the  continuous 
variable  x.  To  this  end,  let  a  be  a  vector  of  length  N  that  contains  the  N  spatial  locations  of  the  intensity  values  of  i(x) 
as  would  be  obtained  for  an  image  collected  with  a  CCD  array.  Then  let  y,  0,  and  q  be  one-dimensional  vectors  that 
contain  the  values  of  i(a),  o(a),  and  n(a),  respectively,  on  the  grid  defined  by  a.  In  addition,  let  H  be  the  block- 
circulant  system  matrix  associated  with  h(a).5  This  permits  rewriting  Eq.(l)  as  a  matrix-vector  equation  given  by 

y  =  H0  +  q.  (2) 


and  the  PDF  oft]  is  denoted  by  f„(q).  In  blind  deconvolution,  the  fiinctionally-independent  parameters  that  generate  the 
elements  of  both  H  and  0  are  estimated.  Let  $  be  a  vector  that  contains  all  of  these  parameters.  For  pixel-based 

N  N 

estimation  of  h(a)  and  o(a)  when  ^o(aJ  and  £h(aj  are  both  fixed  quantities,  only  N-l  elements  of  both  h(a)  and 

n=l  n=l 

o(a)  are  functionally  independent.  Without  loss  of  generality,  we  assume  that  the  first  N-l  elements  of  both  h(a)  and 
0(a)  are  used  to  generate  H  and  0  and  thus  are  the  elements  of  the  vector  O.  The  CRBs  foi  any  unbiased  estimate  of  the 
elements  of  <t>  are  the  diagonal  elements  of  the  inverse  of  the  Fisher  information  matrix,  F,  associated  with  y,  <I>,  and  q. 
Therefore,  we  next  define  F.  Let  f(y;®)  be  tire  PDF  of  y  parameterized  by  the  vector  <£.  Then  the  element  of  F  in  the 
p^  row  and  the  qtil  column  is  given  by 


F  =  E 
pq 


ainf(y;<S)ainf(y;g>) 

ao>  s<x> 


(3) 


where  E[]  denotes  the  expected  value  of  the  quantity  in  the  brackets,  in  denotes  the  natural  logarithm  and  d>p  denotes  the 
p*  element  of  O.  From  Eq.(2),  it  follows  that 

where  the  notation  fp(y  -  H0)  denotes  f^q)  with  q  replaced  by  y  -  H0.  For  Poisson  and  CCD  read  noise,  an  excellent 
approximation  to  Fpq  is  given  by6 


where  the  summation  is  over  all  the  elements  of  a;  (H0)k,  0k,  and  ak  are  the  k  elements  of  H0,  0,  and  a,  respectively; 
and  cr2(ak)  is  the  spatially-dependent  CCD  read  noise  variance.  For  either  type  of  noise  by  itself  (i.e.,  when  either  (H0)k 
or  c2(ak)  is  zero  in  the  last  factor  in  Eq.(5)),  the  corresponding  expression  for  Fpq  is  exact.  The  form  of  Fpq  is  a 
summation  over  all  the  pixel  locations  because  both  Poisson  and  CCD  read  noises  are  spatially  independent  and  thus  the 
joint  pdf  of  the  noise  for  all  pixels  is  just  the  multiplication  of  the  single-pixel  pdfs,  and  the  natural  logarithm  operation 
converts  the  multiplication  to  a  summation. 

Equation  (5)  gives  the  elements  of  F  for  the  imaging  model  of  Eq.(2)  without  the  application  of  any  constraints.  A 
support  constraint  can  be  implemented  easily  by  including  in  the  vector  O  only  the  values  of  o(a)  and  h(a)  for  which  a 
is  in  die  known  support  regions  of  o(a)  and  h(a),  respectively.7 

The  equations  above  are  valid  for  a  single  measurement  frame  but  can  be  extended  easily  to  accommodate  multiple 
measurement  frames.  To  do  so,  assume  that  there  are  M  measurements  to  be  used  to  jointly  estimate  die  pixel 
intensities  of  a  single  object  and  M  PSFs.  First,  create  M  measurement  vectors  separately  as  described  above  and  then 
stack  them  to  create  a  single  composite  column  vector  that  has  MN  elements.  The  composite  noise  vector  is  created  in 
the  same  way.  The  composite  system  matrix  H  is  created  by  stacking  the  individual  system  matrices  in  a  block-column 


manner  so  that  it  has  dimensions  of  MN  by  N.  The  object  vector  0  is  the  same  for  single  or  multiple  measurement 
frames  since  it  is  assumed  to  be  the  same  for  all  the  measurements.  Finally,  the  composite  parameter  vector  <D  contains 
all  the  functionally-independent  object  and  PSF  parameters  for  all  the  measurements  and  thus  has  (M+1)(N-1)  elements 
when  there  are  no  support  constraints.  The  elements  in  <£>  can  be  placed  in  any  desired  order.  When  support  constraints 
are  placed  on  o(a)  and  h(a),  the  number  of  elements  in  <3>  is  reduced  accordingly. 

3.2  Biased  CRB  theory 

The  standard  approach  to  biased  CRB  theory  is  to  generate  the  biased  CRBs  in  tenns  of  the  inverse  of  F  and  tire 
gradient  of  the  bias  with  respect  to  the  parameters.  Mathematically,  let  b(CE>)  be  the  bias  of  an  estimate  of  <£>  and  let  V0b 
be  its  gradient  with  respect  to  $>.  Then  the  CRBs  of  any  estimator  with  bias  b(d>),  BCRB*,  are  given  by 

BCRB*  =diag|v»b)F-'(V^b)T]  (6) 

where  diag[]  denotes  the  diagonal  elements  of  the  matrix  in  the  brackets.  Equation  (6)  assumes  that  F  is  invertible. 
When  it  is  not  invertible,  its  inverse  is  replaced  by  its  pseudo-inverse,  F+,  with  the  requirement  that  the  range  space  of 
(V«j)b)T  is  contained  in  the  orthogonal  complement  of  the  null  space  of  F+.  In  terms  of  our  imaging  model,  this 
requirement  can  be  stated  equivalently  as  that  any  regularization  filter  must  have  a  bandpass  contained  within  the 
bandpass  of  the  imaging  system. 

When  a  support  constraint  is  applied  to  the  imaging  model  of  Eq.(l),  the  forward  model  is  invertible  but  its  inverse  is 
discontinuous.  This  fact,  applied  to  the  discrete  form  of  the  imaging  model  (Eq.(2))  and  F  (Eq.(5)),  means  that  F  is 
invertible  but  highly  ill-conditioned.  For  this  reason,  the  standard  pseudo-inverse  approach  to  generating  an  inverse  of 
F  is  highly  sensitive  to  the  numerical  level  at  which  the  eigenvalues  of  F  are  deemed  to  be  at  or  below  the  numerical 
precision  of  the  computer.  We  have  tried  various  schemes  for  determining  the  best  eigenvalue  cutoff  as  well  as 
methods  other  than  truncation  for  inclusion  or  exclusion  of  eigenvalues  in  the  pseudo-inverse  calculations,  but  have  not 
been  able  to  mitigate  the  sensitivities  of  die  CRB  values  to  the  particular  pseudo-inversion  scheme  employed.  For  this 
reason,  we  have  been  exploring  alternate  ways  to  generate  biased  CRBs  using  a  modified  version  of  Eq.(6). 

In  the  known  PSF  case  when  the  PSF  is  not  invertible  and  a  support  constraint  is  applied,  we  were  able  to  fully 
ameliorate  the  pseudo-inverse  problems8  by  adding  to  die  known  PSF  a  second  PSF  that  is  the  inverse  Fourier  transform 
of  an  ideal  high-pass  filter  that  is  zero  where  the  Fourier  transform  of  the  known  PSF  is  non-zero  and  is  a  small  constant 
everywhere  else.  The  sum  of  the  known  and  high-pas s-filter  PSFs  is  invertible,  permitting  F'1  to  be  calculated. 
Furthermore,  when  the  bandpass  of  the  regularization  filter  is  contained  within  the  bandpass  of  die  imaging  system,  the 
contributions  of  the  high-pass-filter  PSF  to  F'1  are  all  contained  in  the  orthogonal  complement  to  the  range  space  of 
(V®b)T.  This  means  that  the  biased  CRBs  calculated  using  Eq.(6)  depend  only  on  the  system  PSF  and  not  the  high- 
pass-filter  PSF.  For  blind  deconvolution,  unfortunately,  this  approach  does  not  work  because  die  PSF  pixel  values  are 
jointly  estimated  with  die  object  pixel  values. 

For  die  CRBs  in  the  next  section,  we  apply  a  support  constraint  on  the  system  PSF  as  well  as  on  the  object  to  render  F 
invertible  for  use  in  Eq.(6).  Because  the  system  PSF  is  bandlimited,  it  does  not  have  finite  support;  however,  for  large 
enough  support  sizes,  most  of  the  energy  is  contained  in  the  support  region  and  tiius  hopefully  will  have  minimal  impact 
on  the  CRBs.  In  Section  4,  we  will  show  the  impact  of  the  PSF  support  size  on  the  CRBs. 

4.  RESULTS 

We  present  biased  CRB  results  for  pixel-based  blind  deconvolution  in  this  section  for  a  variety  of  scenarios.  For  all  the 
results,  the  object  in  Fig.  1  was  used  to  create  9.  For  the  case  of  M  measurement  frames,  where  M  is  arbitrary,  the 
system  matrix  H  was  created  using  the  M  system  PSFs  that  were  used  to  generate  the  measurement  frames.  Each 
system  PSF  was  created  using  a  Fourier-optics  model  for  incoherent  imaging9  assuming  an  ideal  imaging  system  with 
die  addition  of  phase  distortions  in  its  pupil  (of  diameter  D)  brought  about  by  atmospheric  turbulence  characterized  by 
D/r0  =  4.  The  phase  distortions  from  PSF  to  PSF  are  statistically  independent. 

Using  the  object  and  system  PSFs  described  above,  we  calculated  blind  CRBs  for  various  combinations  of  three 
different  support  constraints  on  the  object  and  two  different  support  constraints  on  the  system  PSF.  For  all  cases,  the 
noise  was  modeled  as  white,  zero-mean  Gaussian  noise  with  a  variance  of  100.  The  diree  object  supports  constraints 


are  shown  in  Fig.  2.  The  first  is  the  true  object  support,  the  second  is  a  blurred  version  of  the  true  object  support,  and 
the  third  is  the  smallest  centered  circle  that  contains  the  true  object.  Both  PSF  support  constraints  are  circular  regions 
centered  on  the  origin.  The  first  has  a  diameter  that  is  33%  of  the  array  width  and  the  second  has  a  diameter  that  is  64% 
of  the  array  width.  Results  will  be  shown  in  this  section  for  a  subset  of  these  parameter  sets.  In  addition,  we  will 
compare  the  blind  CRBs  to  the  corresponding  non-blind  CRBs.  All  CRBs,  both  blind  and  non-blind,  were  calculated 
assuming  that  the  object  was  regularized  using  an  ideal  low-pass  filter  whose  cutoff  frequency  was  just  inside  the  cutoff 
frequency  of  the  imaging  system. 

The  results  corresponding  to  using  the  true  object  support  and  the  33%  circular  PSF  support  as  constraints  are  shown  in 
Figs.  3  and  4.  In  Fig.  3,  two-dimensional  scaled  displays  are  shown  of  the  CRBs  for  the  non-blind  case,  for  the  blind 
case  with  one  measurement  frame,  and  for  the  blind  case  with  ten  measurement  frames.  It  can  be  seen  that  the  non-blind 
CRBs  increase  as  the  distance  from  the  edge  of  the  object  support  region  increases.  The  reason  for  this  behavior  has 
been  discussed  previously .4,B  The  spatial  structure  of  the  blind  CRBs  is  more  complicated  than  for  the  non-blind  case 
and  we  are  not  entirely  sure  at  this  time  why  the  structure  is  the  shape  that  it  is.  Notice  that  the  spatial  structure  is 
essentially  the  same  for  the  one  and  ten  measurement  frame  cases. 


(a)  (b)  (c) 

Fig.  2.  Object  support  constraints  used  in  the  blind  and  non-blind  CRB  calculations:  (a)  true  support  (2)  blurred 
support,  and  (c)  circular  support. 


(a)  (b)  (c) 


Fig.  3.  Scaled  CRBs  when  using  the  true  object  support  and  the  33%  circular  PSF  support  as  constraints:  (a) 
.  non-blind  case,  (b)  blind  case  for  one  measurement  frame,  and  (c)  blind  case  for  ten  measurement  frames. 
The  CRB  maps  are  scaled  to  their  minimum  and  maximum  values.  The  minimum  and  maximum  CRB 
values  are  indicated  by  black  and  yellow,  respectively,  and  intermediate  CRB  values  are  mapped  to  colors 
according  to  the  color  bar  to  the  left  of  the  figure. 
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Fig.  4.  Totals  of  the  unsealed  CRBs  corresponding  to  Fig.  3  as  a  function  of  the  number  of  measurement  frames 
used  in  the  estimation  process. 

The  totals  of  the  unsealed  CRBs  for  an  object  estimate  (that  is,  fee  sura  of  all  fee  unsealed  single-pixel  CRBs) 
corresponding  to  Fig.  3  are  plotted  in  Fig.  4  as  a  function  of  the  number  of  measurement  frames  used  in  the  estimation 
process.  Notice  that  both  the  non-blind  and  blind  CRBs  decrease  at  approximately  the  same  rate  as  a  function  of  the 
number  of  frames.  Notice  also  feat,  although  the  blind  CRBs  are  higher  than  the  non-blind  CRBs,  they  are  still 
relatively  similar  in  magnitude. 

The  results  corresponding  to  using  the  true  object  support  and  the  64%  circular  PSF  support  as  constraints  are  shown  in 
Figs.  5  and  6.  These  results  are  for  the  same  scenario  as  the  results  in  Figs.  3  and  4  with  the  exception  that  fee  area  of 
fee  PSF  support  is  approximately  four  times  larger  in  Figs.  5  and  6.  By  comparing  Fig.  3  with  Fig.  5,  it  can  be  seen  that 
there  is  a  little  difference  in  the  spatial  structure  of  fee  blind  CRBs,  but  not  much.  More  importantly,  it  can  be  seen  by 
comparing  Fig.  4  with  Fig.  6  that  the  totals  of  the  blind  CRBs  have  increased  by  a  factor  of  four.  Clearly,  the  size  of  the 
PSF  support  constraint  plays  a  big  role  in  the  CRB  totals. 

The  results  corresponding  to  using  the  blurred  object  support  and  the  33%  circular  PSF  support  as  constraints  are  shown 
in  Figs.  7  and  8.  Notice  that  fee  spatial  structure  of  the  blind  CRBs  in  Fig.  7  shows  that  the  blind  CRBs  are  much  higher 
at  the  edges  of  the  true  object  support  than  anywhere  else  in  the  blurred  object  support.  This  is  an  interesting  result 
because  the  non-blind  CRBs  are  known  to  always  be  lowest  at  the  edges  of  the  enforced  support  region  for  the  white 
noise  case  considered  here  due  to  noise  correlation  effects,  regardless  of  fee  true  object  support.4,8  The  blind  CRBs  in 


Fig.  5.  Scaled  CRBs  when  using  the  true  object  support  and  the  64%  circular  PSF  support  as  constraints:  (a) 
non-blind  case,  (b)  blind  case  for  one  measurement  frame,  and  (c)  blind  case  for  ten  measurement  frames. 


Fig.  6.  Totals  of  the  unsealed  CRBs  corresponding  to  Fig.  5  as  a  function  of  the  number  of  measurement  frames 
used  in  the  estimation  process. 


(a)  (b)  (c) 

Fig.  7.  Scaled  CRBs  when  using  the  blurred  object  support  and  the  33%  circular-  PSF  support  as  constraints:  (a) 
non-blind  case,  (b)  blind  case  for  one  measurement  frame,  and  (c)  blind  case  for  ten  measurement  frames. 


Fig.  7  are  indicating  that,  when  the  PSF  must  be  jointly  estimated  with  the  object,  and  the  object  support  constraint  is 
not  known  precisely,  the  edges  of  the  object  are  more  difficult  to  estimate  than  the  interior  regions.  The  edges 
correspond  to  high  spatial  frequencies,  so  the  results  in  Fig.  7  imply  that  the  higher  spatial  frequencies  of  the  object  are 
more  difficult  to  estimate  when  jointly  estimating  the  object  and  PSF  pixel  values.  By  comparing  the  blind  CRBs  for 
one  and  ten  measurement  frames,  it  can  be  seen  that  the  addition  of  more  measurement  frames  reduces  the  CRBs  of  the 
object  pixel  value  estimates  at  the  edges  of  the  true  object  support  more  than  in  the  interior.  This  is  indicated  in  Fig.  7 
by  the  fact  that  the  CRBs  interior  to  tire  true  object  support  are  a  higher  percentage  of  the  CRBs  at  the  edges  of  the  true 
object  support  than  for  the  one  measurement  frame  case,  keeping  in  mind  that  each  two-dimensional  display  of  the 
CRBs  is  scaled  to  the  maximum  value  in  each  display. 

Plots  of  the  totals  of  the  blind  and  non-blind  CRBs  as  a  function  of  the  number  of  measurement  frames  corresponding  to 
the  CRBs  in  Fig.  7  are  shown  in  Fig.  8.  Notice  that  both  the  blind  and  non-blind  CRBs  are  larger  than  the 
corresponding  results  in  Fig.  4  because  of  the  less-accurate  object  support  constraint.  In  addition,  notice  that  the  blind 
CRB  for  one  measurement  frame  is  approximately  a  factor  often  larger  than  when  the  perfect  object  support  is  used  as  a 
constraint,  while  the  corresponding  factor  for  the  non-blind  case  is  approximately  a  factor  of  two  larger.  This  implies 
that  blind  deconvolution  is  more  sensitive  to  the  accuracy  of  the  support  constraints  than  is  non-blind  deconvolution. 
Finally,  notice  the  large  decrease  (a  factor  of  five)  in  the  blind  CRBs  when  two  instead  of  one  measurement  frames  are 
used.  This  behavior  is  one  we  have  noticed  when  using  our  blind  deconvolution  algorithm  on  real  data  -  the  results 
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Fig.  8.  Totals  of  the  unsealed  CRBs  corresponding  to  Fig.  7  as  a  function  of  the  number  of  measurement  frames 
used  in  the  estimation  process. 

from  including  two  or  three  measurement  frames  in  the  estimation  process  are  much  less  noisy  than  when  including  just 
one  measurement  frame. 

The  final  results  to  be  presented  are  shown  in  Figs.  9  and  10  for  the  case  of  using  a  circular  object  support  constraint 
and  the  33%  circular  PSF  support  constraint.  The  conclusions  to  be  drawn  from  these  figures  are  qualitatively  the  same 
as  those  drawn  from  Figs.  7  and  8.  As  before,  the  spatial  structure  of  the  non-blind  CRBs  are  a  function  of  the  applied 
object  support  constraint,  not  the  true  object  support  region.  The  spatial  structure  of  the  blind  CRBs  is  a  function  of  the 
true  object  support,  not  the  applied  object  support,  and  are  higher  at  the  edges  of  the  true  object  support.  In  addition,  the 
blind  CRBs  at  the  edges  of  the  true  object  support  decrease  faster  as  more  measurement  frames  are  added  than  do  the 
blind  CRBs  interior  to  the  true  object  support.  We  see  a  large  decrease  in  the  blind  CRBs  when  including  two  instead  of 
one  measurement  frames  in  the  estimation  process  as  was  the  case  when  applying  the  blurred  object  support;  however, 
the  decrease  is  a  factor  of  sixty  instead  of  only  a  factor  of  five.  This  means  that  including  more  measurement  frames  in 
a  blind  deconvolution  algorithm  is  much  more  important  when  the  applied  object  support  constraint  is  less  accurate  than 
when  the  applied  object  support  constraint  is  more  accurate. 


(a) 


(b) 


(c) 


Fig.  9.  Scaled  CRBs  when  using  the  circular  object  support  and  the  33%  circular  PSF  support  as  constraints:  (a) 
non-blind  case,  (b)  blind  case  for  one  measurement  frame,  and  (c)  blind  case  for  ten  measurement  frames. 
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Fig.  10.  Totals  of  the  unsealed  CRBs  corresponding  to  Fig.  9  as  a  function  of  the  number  of  measurement  frames 
used  in  the  estimation  process. 

5.  CONCLUSIONS  AND  FUTURE  WORK 

We  have  presented  CRBs  for  blind  deconvolution  in  this  paper  and  compared  them  to  the  corresponding  non-blind 
CRBs.  The  CRBs  were  generated  assuming  that  the  measurements  consisted  of  the  sum  of  a  true  object  blurred  by 
atmospheric  turbulence  and  white  Gaussian  noise.  It  was  further  assumed  that  the  information  incorporated  in  the  blind 
estimation  process  included  both  object  and  PSF  support  constraints;  obviously,  no  PSF  support  constraint  is  needed 
for  tire  non-blind  case.  We  showed  that  the  blind  CRBs  are  always  larger  than  the  non-blind  CRBs  -  an  expected  result 
since  more  parameters  are  estimated  in  the  blind  case.  We  also  showed  that,  although  both  blind  and  non-blind  CRBs 
increase  as  the  size  of  the  applied  object  support  constraint  increases,  the  blind  CRBs  increase  much  faster  than  the  non¬ 
blind  CRBs. 

There  are  several  properties  of  the  blind  CRBs  that  are  unique  to  blind  deconvolution.  The  first  is  that  a  PSF  support 
constraint  is  needed  and  the  blind  CRBs  are  an  increasing  function  of  the  size  of  this  support.  We  have  included  a  PSF 
support  constraint  in  order  to  malce  the  Fisher  information  matrix  invertible  for  non-invertible  PSFs  due  to  the  way  that 
the  biased  CRBs  are  calculated.  A  PSF  support  constraint  generates  a  bias  in  the  CRBs  in  addition  to  the  bias  produced 
by  regularization.  As  the  PSF  support  size  increases,  the  bias  decreases  with  a  concomitant  increase  in  variance.  In 
future  work  we  plan  to  revisit  how  we  calculate  biased  CRBs  to  remove  this  aspect  of  bias  from  their  values.  We  note, 
however,  our  initial  investigations  of  bias  versus  variance  in  the  context  of  PSF  support  constraints  indicates  that  there 
is  a  large  decrease  in  variance  for  a  small  increase  in  bias;  therefore,  it  may  be  appropriate  to  always  include  PSF 
support  constraints. 

The  second  property  we  wish  to  mention  is  that  the  spatial  structure  of  blind  CRBs  is  a  function  of  the  true  object 
support,  not  tire  applied  object  support,  unlike  for  the  non-blind  CRBs.  In  particular,  the  edges  of  an  object  are  harder  to 
estimate  accurately  than  is  the  interior  of  an  object.  Because  edges  are  important  cues  for  the  human  visual  system,  this 
is  a  severe  drawback  of  pixel-based  blind  deconvolution  algorithms. 

In  the  future,  we  plan  to  extend  this  work  to  blind  deconvolution  algorithms  where  the  PSF  is  parameterized  by  a  modal 
decomposition  of  the  phase  in  the  imaging  system  exit  pupil.  Our  experience,  and  the  experience  of  others,  is  that  blind 
object  reconstruction  with  this  parameterization  of  the  PSFs  is  much  more  accurate  than  pixel-based  blind 
deconvolution. 
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